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In this paper, the quantum phase transition between superfluid state and Mott-insulator state is 
studied based on an extended Bose-Hubbard model with two- and three-body on-site interactions. 
By employing the mean-field approximation we find the extension of the insulating 'lobes' and 
the existence of a fixed point in three dimensional phase space. We investigate the link between 
experimental parameters and theoretical variables. The possibility to obverse our results through 
some experimental effects in optically trapped Bose-Einstein Condensates(BEC) is also discussed. 
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I. INTRODUCTION 

Quantum phase transitions in uhracold atoms(BEC) 
exhibit fascinating phenomena and attract much atten- 
tion since such a system with controllable interactions be- 
tween atoms had been realized experimentally by loading 
the condensate into an optical lattice [l| . The behavior of 
the BEC in optical lattices can be well described by the 
Bose-Hubbard model @, i, i, H, H, 0, S S d El d 
which predicts a superfluid-insulator transition under 
certain critical conditions for the interatomic interaction 
strengths. The rich phenomena as well as sophisticated 
phase diagrams resulting from quantum many- body ef- 
fects have been explored plentifully [Tsl. [T^. [Tsl. IigI. [TtI. [isl. 
[iqI . [20| . Most previous discussions assumed that inter- 
actions between three and(or) more trapped bosons are 
negligible so the system is merely controlled by the two- 
body interaction and tunneling effect which allow bosons 
to hop around within the optical lattice. 

However, it has been an intriguing question of pursuing 
some exotic phases associated with Hamiltonians with 
three- or more-body terms [2l| for a long time. Quite re- 
cently, Biichler et al. [l^l suggested that polar molecules 
in optical lattices driven by microwave fields naturally 
give rise to Hubbard model with strong nearest-neighbor 
three-body interaction, while the two-body term can be 
tuned with external fields. This may lead to some inter- 
esting quantum phases when generalized to more compli- 
cated situations. 

In the present work, we discuss the superfluid to Mott- 
insulator transition of cold bosons in optical lattices with 
two-and three-body repulsive interactions. We find that 
in the strong coupling limit, an effective on-site Hamil- 
tonian can be derived with a decoupling mean-field ap- 
proximation developed in Ref. [l^. We then calculate 
the energy of this Hamiltonian using perturbation the- 
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ory and discuss the critical behavior at transition point 
with Landau order parameter expansion. We find that 
due to the presence of the three-body interaction, the 
Mott-insulator areas expand to three-dimensional curved 
surfaces, and these 3D insulating 'lobes' rotate with re- 
spect to a fixed point in the phase space, as more atoms 
are populated on the lattice sites. We then analyze some 
experimental parameters corresponding to the theoreti- 
cal quantities discussed here and suggest some practical 
ways to verify our results. 



II. MEAN-FIELD APPROXIMATION 

In this section, we first derive the effective Hamiltonian 
in the mean-field approximation and then calculate the 
energy of this Hamiltonian by applying perturbation the- 
ory up to the fourth order. The equation of critical curves 
separating the Mott insulator and superfluid phases are 
obtained through Landau order parameter expansion for 
second-order phase transitions. 



A. The Effective Hamiltonian 

We assume that the atoms are in the lowest band of 
the optical lattice, thus their behaviors can be described 
by an (extended) Bose-Hubbard Hamiltonian 

H = -t^c\cj + - 1) 

+ -^y^n,(n, - l){hi - 2) - A^J^nj, (1) 

i i 

where the summation in the first term is done for the 
nearest neighbors only and cj(ci) is the bosonic cre- 
ation(annihilation) operator with fii the particle number 
operator for bosons at site i. The parameter t is the hop- 
ping term(tunneling amplitude) and U{W) is two(three)- 
body repulsive interaction strength between bosons. The 



2 



chemical potential /i is introduced to conserve the num- 
ber of atoms in the grand-canonical ensemble. 

In the strong coupling limit, namely, t <^ min{U,W}, 
it is convenient to introduce a superfluid order parame- 
ter [iB] V' = V = (cl) — i^i) to construct a consis- 
tent mean-field approximation by substituting the hop- 
ping term in Eq. ([T]) as 



{4)cj + 4{cj) - (4) (cj) = M + 9) - V''. (2) 

Thus the effective Hamiltonian becomes 



W 



l)(n,-2) 



1) 
(3) 



— {cl+Ci), representing the small kinetic energy of bosons 
near the insulating phase. The ground-state energy of 
is 



I J r 



u w 

Y5(.9-1) + y5(5-1)(5-2)-M5, (6) 



where En"' denotes the unperturbed energy of states with 
integer fillings and g is an integer specifying the average 
particle number on a lattice site. 

In the occupation number basis, the odd powers of the 
expansion of Eq. ([5]) with respect to ^p vanish. There- 
fore, the correction to the energy can be calculated to 
the second-order 



where z is the coordination number of optical lattices 
and Ns is the total number of lattice sites. It can be 
diagonalized and rewritten with respect to the site index 

i as 
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„) 




< 







(7) 



h: 



cff 



-Jihi - ii{c\ -I- Ci) -t- 1/'^, 



(4) 



where dimensionless parameters U = U / zt, W = W/zt 
and JI = fj,/zt illustrate relative strengths between re- 
pulsive interactions (two- and three-body) and tunneling 
effect (the hopping term t) . This on-site Hamiltonian can 
be applied equally to every lattice site so we will omit the 
index i in following discussions. 



with 



0-2 



(5-l)C/+i(5-l)(5-2)M/-M 



.9+1 



Jl~gU-y{g^l)W 
and to the fourth-order 



(8) 



B. Perturbation Theory 

In the strong coupling regime, we apply perturbation 
theory to calculate the energy of Eq. To achieve 

this, we rewrite Eq. ^ as 



(5) 



with the unperturbed Hamiltonian i?'"' = ^■h{h — 1) + 
■^n(n — l)(n — 2) — Jin + ip"^ , and the perturbation V = 



V 



n\V\p 



-E^„ 



n V g 



{Ei'^-Ei'^y 



V 



V 



p(0) p(0) p(0) p(0) p(0) p(0) 



with 



(9) 
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g(g - 1) 

[(.g - 1) 17 + i (.g - 1) (.9 - 2) W - 71] ' [(2.g - 3)17 + {g - 2fW - 271] 

^ (g + 1) (g + 2) 

[71 - gI7 - ig (g - 1) W] ' [27I - (2g + 1) 17 - gm\ 

g , g + 1 



(g - 1) C/ + i (g - 1) (g - 2) - 71 7I " gC/ - ig (g - 1) 

g , g + 1 



((g - 1) (7 + i (g - 1) (g - 2) - 71) (77 _ ^[7 _ 1 g (5 _ l) ly) ^ 



(10) 



Here, |n),|p),|g) denote unperturbed states with n,p,q 
particles. 



C. Landau Order Parameter Expansion 

We then follow the ordinary procedure for second or- 
der phase transitions by writing the ground-state energy 



Eg [tp) = eII^^ + Eg"' + Eg"^' + ... as an expansion in ^j, 
with an implication that the superfluidity cannot be large 
in the strong coupling region: 



(2) 



(4) 



Egii^) = ao{g,U,W,-p) + [ 
+04 {g,U,W,-p)iP 



a2 {g,U,W,Jl)]^^ 
0{^'). (11) 



By minimizing Eq. (jll[) with respect to the superfluid 
order parameter ip, we obtain the critical condition 1 -|- 
02 = signifying the boundary that separates insulator 
and superfluid phases, which yields 



1 

^± = 2 



{2g-l)U +ig-iyW -1 



1 

± - 
2 



with 



A 



U +{g 
-2{2g + 
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l)U 



2{g - 1)UW 
2{2g + l)ig - l)W 



(12) 



1, (13) 



where the subscript ± denotes the upper and lower halves 
of the Mott insulating regions in phase space. The pa- 
rameter A will play a significant role in determining 
phase diagrams, which will be discussed in detail in the 
next section. 

For given particle number g, the weak superfluidity is 



1+Q2 

2a4 ' 



(14) 



which is illustrated in Fig. [TJ Here, we would like 
to make a remark on our decoupling-Landau expansion 
scheme. This method was originally introduced [l6t as 
an alternative way of the usual Bogoliubov approxima- 
tion, which did not predict the phase transition. Instead 
of considering number fluctuations with respect to the 



number of condensed atoms in Bogoliubov treatment, de- 
coupling method approximates the kinetic term as site- 
independent and weak, thus it reveals the expected tran- 
sition. But it only works well in the strong- coupling limit 
[U /t, W/t ^ 1), making hopping as perturbations in ex- 
pansion of E [ijj) . It cannot describe the system properly 
in the weak-coupling limit, as shown in right plot of Fig. 
[T] ip'^ tends to decrease towards zero as repulsions de- 
cline. Also, in the case oi g = 1,U = 0, ip^ exhibits 
strange behavior which is really beyond our approach 
(the system should be a weak-interaction BEC in this 
sense, we shall discuss it elsewhere). The incorrectness 
stems from the limited effective range of our approach. 



III. THE PHASE DIAGRAMS 

In this section, we present the phase diagrams based on 
results obtained in the previous section and demonstrate 
their physical meanings with the help of Eq. (|13p . 

According to Eq. p2|) , physically acceptable solutions 
of the reduced chemical potential Jl require that A > 0. 
This restriction, which guarantees Jl being real-valued 
and the existence of Mott insulating phases, can be vi- 
sualized in Fig. [2] as we set Eq. (|13p to be zero. In 
fact, solutions to A = are a set of parallel lines in the 
U-W plane. They divide the plane into two parts: areas 
to their right correspond to A > 0, which implies the 
appearance of the Mott-insulating phase; areas to their 
left correspond to A < 0, which implies the appearance 
of the superfluid phase. Areas with negative values of 
(U or W) are not shown since we only consider repulsive 
interactions among atoms. 

The critical line is perpendicular to the C/-axis with 
an intercept of Uc — 5.83 when g — 1, which is exactly 
the transition point of system with pure two-body inter- 
action. It seems to be contradictory, since according to 
Eq. both the two-body and the three-body terms 

have to vanish at g = 1, and the system ought to behave 
as a non-interacting BEC. We can understand it in the 
following way: 

Although the on-site repulsion Uhi{ni — 1) vanishes at 
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FIG. 1: (Color online) Illustrations of superfluid order parameters ip'^ according to Eq. (|14p . Left: with fixed repulsion and 
varying chemical potential Jl sd, g = 1. The black line denotes U — 6,W = 0; The red dash line denotes U = 0,W = 6. Right: 
with Jl — (g — + — and varying U ,W . The solid line denotes g = 1, the dash lines denote g = 2. 



20 



15 



^10 





g=i 


\g=2 










F(5.83,4.01) 


g=4^ 



10 
U(zt) 



15 



20 



FIG. 2: Illustration of solutions to A = with different occu- 
pancy g. The critical lines are tilting down as g increases and 
all of them intersect around a fixed point point F(5.83, 4.01). 



single occupancy, two-body interactions can take place 
due to weak (perturbative) tunneling effect. It enables 
one boson to 'jump' from one site to its nearest neigh- 
bors, so the on-site repulsion between two bosons appears 
again, raising energy and may forbid the occupation of 
an additional atom if U is strong enough. In short, when 
hoppings are added as perturbations (the Landau expan- 
sions inip'^), the condensate can exhibit a weak superfluid 
phase. In the large U/t regime, hoppings are prohibited 



and the condensate becomes insulating. 



Similarly, three-body interactions Whi{hi — l)(hi — 2) 
may appear as two (or more) bosons successively move 
onto an occupied site. But these processes are hidden 
in higher-order terms {ij}'^ and above) in our kinetic- 
perturbation expansion, thus can be neglected here. This 
explains the absence of three-body interactions at g = 
1. Hence, the condensate can be described as a weak- 
interacting BEC with finite two-body repulsions and can 
have the Mott transition. 



When (7 = 2, the J7-term is recovered while the W- 
term can emerge by adding hopping perturbations (with 
one atom jumping). So the system can either be a weak 
superfluid or an insulator, depending on the ratio U/t 
and W/t. 



In addition, three-body term will surpass the two-body 
one gradually as g increases. From Fig. [5J we can see 
that as there are more particles on sites, intercepts of 
the critical lines to W-axis become smaller; when ^ cxd, 
the intercept goes to Wc = 4.01. In fact, all the lines 
with different g intersect around the point i^(5.83, 4.01) 
and rotate with respect to it: from being perpendicular 
to the U -axis when 5 = 1 to being parallel to the U -axis 
when g 00. 



This behavior can be straightforwardly explained from 
the dispersion relation (obtained in a similar way as in 
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Ref. [1^ by using an effective action method) 
1 



huj+ = 



(2.9 -l)U+{g- ly - efc - ± 
[/2 + (g - if VK^ + 2 (5 - 1) UW- 



20r g- 



2 (2.9 + 1) ekU - 2 (2.9 + 1) (.9 - 1) e^VK + el] ^'^ , 

(15) 

where = 2t ^^^j^ cos (fc^a), "±" denote excitations of 
quasi-particles (adding particles to sites) and quasi-holes 
(removing particles from sites), respectively. Further- 
more, by subtracting the two solutions, we can obtain 
the energy gap 




W(zt) iJfzt) W(zt) Jfzt) 



+ (g - ly W^ + 2{g-l) UW - 



2 {2g + 1) ekU ~2{2g + 1) (5 - 1) euW 
At the transition point, = and wc have 



(16) 



-Uc+ 2.9 + 2/9(.9 + l) + l Efc 
Wc = ^ ^ (17) 



This equation shows the (7-dependence Uc and Wc '■ as g 
grows, the slope (.9 — 1)~ decreases; so that Uc increases 
while Wc declining to a fixed value at about 4efc. For k = 
0, efc = zt, the dispersion relation ([15]) becomes the phase 
boundary cquation fT^ . while turning to z^t^A. Let 
A = 0, the relation between U c and Wc is 

Uc + {g-l)Wc = 2g+l + 2^g{g + 1). (18) 

When 5 — > 00 and J7c = 0, M^c ~ 4; when .9 = 1, Wc is 
divergent and C/c ~ 5.83. 

The physical meanings of this rotation of critical lines 
may be easier to comprehend when we plot the complete 
phase diagrams in three-dimensions in Fig. [3l The well 
known Mott insulating 'lobes' now expand to a set of 
curved surfaces, meanwhile the transition points become 
the critical lines in Fig. [21 As .9 increases, these surfaces 
rotate with respect to the fixed point F(5.83, 4.01). 

Figure [4] shows the superfluid phase and Mott insula- 
tor lobes of condensate with pure two-body and three- 
body interactions, respectively. As we can see, the three- 
body interaction enlarges the areas of Mott lobes sig- 
nificantly, which is contrary to pure two-body situation, 
whose lobes shrink as g increases: According to Eq. (fT^ 
and (|13p. breadths of different [/-lobes are 1 while W- 
lobcs' breadths are expanding as (9 — 1) in the unit of 
ji/U and fi/W, respectively. 



IV. THE EXPERIMENTAL PARAMETERS 
AND SUGGESTIONS 

The trapping potential is the sum of a homogeneous 
periodic lattice potential formed by three orthogonal, in- 
dependent standing laser fields with a tunable barrier 
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FIG. 3: (Color online) Mott-insulating 'lobes' in 3D phase 
space. The areas enclosed within lobes indicate insulating 
phase. Space outside these curved surfaces is superfluid phase. 
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FIG. 4: (Color online) Phase diagrams of superfluid-Mott in- 
sulator transition with pure two-and three-body interactions. 
The red lines are associated with pure three-body interaction 
and the black dot lines are associated with pure two-body 
interaction. 



height Vo [201 ■ For a deep optical lattice this sine-like 
trap can be approximated as a harmonic well as 



V{x, y, z) = Vb (sin'^ kx + sin'^ ky + sin^ kz') 
» {x^ + y^ + z^) , 



(19) 



where A: = 27r/A is the wave vector with A the wave length 
of the laser. The Wannier function at the lowest band in 
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the well can be approximated as a Gaussian ground-state 

„2 ~ 



w{r) 



12 2 



(20) 



where 



(2mVok^/h?) " is the characteristiclength 



of harmonic oscillators. The interaction parameter U and 
W are thus given by integrals over the Wannier function 



and 



U = g2 dr \w{r)\' 



W 



g3 / dr\w{r)\ =53 



Er 



(21) 



VStt) In [Ct]^] 



ma 



(22) 



where (72 = Airh'^as/'m is the coupling constant of the 
delta-type repulsion between two bosons with the s- 
wave scattering length and m the mass of bosons, while 
Er = h^k^/2m is the recoil energy. The three body cou- 
pling constant has been calculated in a previous work (23j 
as 



53 



:ln(Cry2 



(23) 



where ?/ = y l^/"] is the dilute gas parameter and the 
constant C in the argument of the logarithm can be de- 
termined b y a pplying a microscopic description demon- 
strated in [2l|. In the limit Vo ^ Er, the tunneling 
amplitude t can be obtained from the exact result for the 
width of the lowest band in the one-dimensional Mathieu 
equation as [l7j 



where a^fc^ ranges from 10~* to 10~^ in current experi- 
ments [23|- As we can see, in this context, the strength 
of three-body interaction is much weaker than its two- 
body counterpart, which means that three-body effects 
can hardly be observed. This is consistent with the cur- 
rent experiments where the manipulation of two-body in- 
teractions U is accomplished through changing the depth 
of the optical well Vq. 

However, as Ref. [22| pointed out, by loading the polar 
molecules into the optical lattice and adding an external 
microwave field, one can achieve a situation where only 
observable three-body interaction exists. It may open a 
promising route for an experimental study of controlling 
different interatomic repulsions individually, and the sys- 
tem can be possibly prepared with pure three-body inter- 
action. Moreover the experimental techniques like Fesh- 
bach resonance for molecules [2^ and the rapid progress 
in dipolar condensate [1^1 provide us more opportunities 
to tackle the many-body problems in cold atomic gases. 
In that case, the above discussions on the exotic quantum 
phases and the new type of Mott-Hubbard transition can 
be examined. 



V. CONCLUSIONS 

In this paper, the superfluid-insulator transition with 
many-body interactions between optically-trapped ultra- 
cold bosonic atoms is discussed. We find the extension 
of the Mott-insulating areas and the existence of a fixed 
point in phase space. Finally, we explore the possibility 
of realizing the theoretical predictions and suggest some 
experimental means to test our results. 



-Er[^ 
l-K V Er 



(24) 
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